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Abstract. In this paper we present a novel architecture for storing vi¬ 
sual data. Effective storing, browsing and searching collections of images 
is one of the most important challenges of computer science. The design 
of architecture for storing such data requires a set of tools and frame¬ 
works such as SQL database management systems and service-oriented 
frameworks. The proposed solution is based on a multi-layer architecture, 
which allows to replace any component without recompilation of other 
components. The approach contains five components, i.e. Model, Base 
Engine, Goncrete Engine, GBIR service and Presentation. They were 
based on two well-known design patterns: Dependency Injection and In¬ 
verse of Gontrol. Eor experimental purposes we implemented the SURE 
local interest point detector as a feature extractor and iL-means cluster¬ 
ing as indexer. The presented architecture is intended for content-based 
retrieval systems simulation purposes as well as for real-world GBIR 
tasks. 


Keywords: WCF, Microsoft SQL Server, Dependency Injection, Inversion of 
Control, Entity Framework, Multi-layer Architecture, /c-means, SURF, Content- 
Based Image Retrieval 

1 Introduction 

Images are created everyday in tremendous amount and there is ongoing research 
to make it possible to efficiently search these vast collections by their content. 
Generally, this work can be divided into image classification mm and image 
retrieval m- Recognizing images and objects on images relies on suitable feature 
extraction which can be basically divided into several groups, i.e. based on color 
representation [28], textures [48], shape [50] [52], edge detectors [12] [43] [53] or 
local invariant features, e.g. SURF [2], SIFT [34] or ORB [46]. Matching features 


can be also performed by several methods, e.g. clustering, nearest neighbour, bag 
of features [21] or soft computing p!5][30]. 

There are many content-based image processing systems developed so far. A 
good review of such systems is provided in m- To the best of our knowledge 
no other system uses similar set of tools to the system proposed in the paper. 
Now we describe briefly the most important tools used to design the proposed 
framework. 

1.1 Windows Communication Foundation 

Windows Communication Foundation (WCF) is a framework based on Service- 
Oriented Architecture mm- WCF allows to send data asynchronously between 
two service and client endpoints. Service endpoints can be deployed on IIS server 
or be hosted locally. The messages can be send as XML (value types) or binary 
file (complex types) [9][29][35|[39| . WCF consist of following features: [45][49] 
Service Orientation, Interoperability, Multiple Message Patterns, Service Meta¬ 
data, Data Contracts, Security, Multiple Transports and Encodings, Reliable and 
Queued Messages, Durable Messages, Transactions, AJAX and REST Support, 
Extensibility. 

1.2 SQL Sever 

MS SQL Server is a database management system for storing various types of 
data, fully supporting cloud computing technologies mmmm- It provides a 
set of tools to extract data from various devices or sources, even at datacenters. 
MS SQL query language, T-SQL (Transact-SQL), allows for both structural 
or procedural queries El [10] [l3] [31] [37] [38] . The DBMS (Database Management 
System) is based on a client-server architecture. The platform is composed of 
the following services: mm 

— Database engine - allows to execute queries and is necessary to run the server, 

— Integration Services (SSIS, SQL Server Integration Services) - ETL (Extrac¬ 
tion, Transformation and Loading) platform responsible for data migration 
from the heterogeneous data sources, 

— SQL Agent - answerable for performing tasks according to the specified 
schedule, 

— Eull-text Eilter Daemon Launcher - allow to perform full-text searches on 
text columns, 

— Reporting Services (SSIS, SQL Server Reporting Services) - responsible for 
designing and deploying reports, 

— Analysis Services (SSAS, SQL Server Analysis Services) - allows to create 
multidimensional cubes and executing MDX (Multidimensional Expressions) 
queries [25] . 

DBMS store data in a relational form (tables and their relations) and allows 
to select information by executing queries. Many frameworks perform object 
relational mapping. In this paper we use Entity Eramework (EE) with Code 
Eirst approach mum- 


1.3 Dependency Injection and Inverse of Control 

Re-usability of existing components is crucial in modern software engineering. 
The aim of this approach is to combine separate layers into one application. 
This is a challenging task, because as the application complexity increases, so do 
dependencies [7]. The best practice for tone down proliferation of dependencies 
is by using Dependency Injection (DI) design pattern allowing to inject objects 
into a class constructor. Thus, the creation of the object does not rely on a 
class. The initialization logic is rarely reusable outside of created component. 
That pattern provides a layer of abstraction for the injected object, thus we can 
implement the concrete logic in the other component and inject it in the class 
constructor by the interface. DI [39] is an implementation of Inverse of Control 
(IoC)[20|[44|[47]. Figureshows the typical class dependencies. Such a scheme 
entails the following problems [36] : 

1. Any code changes of Service A forces changes in Class thus the recompi¬ 
lation of all components is required, 

2. All classes must be implemented and available at the compile time, 

3. Classes are difficult to test and to achieve components isolation, 

4. Contradicts the (DRY) Don’t Repeat Yourself principle. 

To resolve this issue we used the Dependency Injection mm- A Conceptual 
view of DI is presented in Figure 



Fig. 1. Problem illustration of tightly coupled dependencies. ClassA uses ServiceA 
and Services. This is a simple representation of ClassA dependencies on ServiceA 
and Services. 
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Fig. 2. Solution of the problem formulated in Fig.^ The Inverse of Control pattern can 
be implemented by Dependency Injection. Builder creates ClassA which uses abstract 
interface IServiceA. Dependencies of ServiceA are injected to ClassA by inheritance. 


2 Proposed Architecture For Storing Visual Data 

Proposed architecture is based on two main components. The first one is SQL 
database which is Microsoft SQL Server, and the second one is Windows Com¬ 
munication Foundation (WCF). Our approach consists of five main layers (tiers): 

1. Model - which contains data model generated by the Entity Framework (6.1) 
with Code First approach, 

2. Base Engine - consist of several abstract classes or interfaces which can be 
used to implement user solutions, but they provide appropriate business 
logic, 

3. Concrete Engine - implements user logic based on previous the layer (in 
this paper we implemented the SURE descriptors for feature extraction and 
/c-means clustering m for indexing), 

4. CBIR Service (for more about CBIR see [23] [22]) - which is WCE service that 
allows to invoke engine methods as Service Oriented Applications (SOA). 

5. Endpoint (Client) - presentation layer for invoking service methods, it can 
be desktop, web or mobile application. All the user needs to do, is to add 
service reference and invoke methods. 

The agility applied in the presented approach is important, because it is not 
restricted to any particular implementation and it can be applied in various 
solutions. The architecture is presented in Eig. Ilf- 

The Base Engine and Concrete Engine layers are based on two design pat¬ 
terns, i.e. Dependency Injection (DI) and Inverse of Control (loC) described 
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(b) Entity diagram based on database tables. 


Fig. 3. Multi-layer architecture and entity diagram of the proposed approach. 


in Section |1.3[ These patterns allowed to separate the containers and main¬ 
tain the S.O.L.I.D. principles [39]. Components are composed of a set of classes 
or interfaces. Each component has a representation in UML (Unified Model¬ 
ing Language) diagram. Figure shows the model layer, which contains five 
classes and two interfaces. Classes: Bin, Histogram and Image were gener¬ 
ated by the Entity Framework and they correspond with the database tables 
presented in Fig. Dd. Interface I Repository Base is a generic interface which 
provides the basic C.R.U.D. (create, read, update and delete) operations. The 
methods allow to operate on any types of objects. The GenerieRepository 
implements I Repository Base interface. In addition, the dataContext field is 
generic, thus the concrete implementation does not contains any dependencies. 
The GenerieRepository class is based on the Singleton pattern, to create in¬ 
stance which user needs to use static method Getinstanee. A very interesting 
interface is I Feature, which allows to implement any type of image features (an 
image descriptor). 


Fig. 123 represents a class diagram for the Base Engine layer, which contains 
items for feature extraction {IFeatureExtraetor), feature indexation {Feature 
Indexer), operations executions {lExeeutor, ExeeutorBase) and simulation 
{SimulationEvaluator, RetrievalFaetors). lExeeutor provides abstract meth¬ 
ods for following operations: index creation and deletion, query execution and 
image insertion. It contains one property: repository. IFeatureExtraetor is re- 
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Fig. 4. Class diagrams for Concrete Engine and Base Engine layers. 
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(a) Class diagram for Model layer. 


(b) Class diagram for CBIR Service layer. 


Fig. 5. Class diagrams for Model and CBIR Service layers. 


sponsible for feature extraction and contains: Features property and Extract- 
Features method. The first one stores previously extracted features, the second 
one extracts features from image passed as a parameter. The method is only 
a definition, thus the class that will implement that interface must contain its 
own version. Feature Indexer consists of one field (histograms) which is a com¬ 
position relation with the Histogram class. Methods are abstract, thus they 
require concrete implementation in the inherited class. ExeeutorBase is a base 
class that uses the dependency injection to initiate object, that allows to in¬ 
ject logic. The RetrievalFaetors contains fields that describes the query results. 
The Concrete Engine layer (see Fig.|^) is designed and presented for simulation 
purposes. We implemented SURF [3] [19] [24] as a feature extractor and /c-means 
method as a indexer. Figure [^ shows diagram for the CBIR Service layer. Each 
WCF service consists of the following items: 

— Interface - defines the method e.g. Ilmage Retrival Serviee^ 

— Implementation class - implements the method’s body e.g. Image Retrieval 
Serviee, 

— Contract (optional) - required to retrieve data from the service Image Contraet. 

CBIR Service component contains two services: simulation service is used to 
perform simulations on the created index. The most interesting methods are 
SimulateMultiQuery and SimulateSingleQuery. The first one returns a list of 



















Retrieval Factors and performs multi query. The second one executes a sin¬ 
gle query. The image retrieval service allows to execute queries. The difference 
between SimulateSingleQuery and ExecuteQuery methods are the following: Ex- 
ecuteQuery returns a list of retrieved images, SimulateSingleQuery returns a list 
of factors {precision^ recall) which allows to evaluate index efficiency. The pro¬ 
posed architecture was designed in .NET framework and written in C#. 


3 Experimental Results 


Experiments were carried out using the designed architecture. The created end¬ 
point was a desktop application with service reference to CBIR Service. Re¬ 
search includes experiments on various objects with background described by 
the SURE local interest point descriptor [34]. Test images were taken from the 
Corel database. We chose images with various types of objects. In experiments 
we used 90% of each class for index creating and 10% as query images. In Tabjl] 
we presented the retrieved factors for each query image. Tab. shows retrieved 
images for a query image (the image with border). 

Eor the purposes of the performance evaluation we use two measures; preci¬ 
sion and recall [40]. Eig.j^shows the performance measures of the image retrieval. 
The AI is a set of appropriate images, that should be returned as being similar 
to the query image. The RI represents a set of returned images by the system. 
Rai is a group of properly returned images. Iri represents improperly returned 
images, anr proper not returned and inr improper not returned images. The pre¬ 
sented measure allows to define precision and recall by the following formulas 


m- 

I rai I 

precision = ^-r, 

\rai + iri\ 


( 1 ) 


recall = 


I rai I 

|rai + anr| ’ 


( 2 ) 



Fig. 6. Performance measures diagram. 
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Table 1. Simulation results for 
multi query. Measures were nor¬ 
malized and presented as per¬ 
centage value [%]. 
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Table 2. Query results. Eighteen exam¬ 
ple images from the experiment. The image 
with border is the query image. 


4 Final Remarks 

The presented approach is a novel architecture for storing visual data. We used 
SQL Server and WCF services as a core of our method. The proposed solution 
for storing visual data has no dependencies with concrete implementation, thus 
we can simulate any CBIR method. Our approach allows creating any type of 
endpoint: desktop, web or mobile application. It can be used as a core back¬ 
end solution. The performed experiments proved effectiveness of our method. 
Our paper present a part of a larger system that allows to search and identify 
specific classes of objects. 
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